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ABSTRACT 

The new economic realities, the slowdown in college 
enrollments and the lingering animosity toward the university in some 
localities have combined to undermine the rather enviable position 
that state university systems previously enjoyed. State capitals* 
response to these realities is an increased emphasis on program 
effectiveness. In an effort to cope with the challenge of 
effectiveness, a refevaluation of institutional goals is imperative. 
Goal setting at the public institutions should involve integrating 
the desires of people on the campus with those of the citizens in the 
region and the statewide planners. Five areas that colleges Ccin 
conceive of institutional effectiveness and fulfill institutional 
objectives aret student learning, student value development, 
programmatic responsiveness, campus morale, and number (application 
and enrollment figures) . A 14-item bibliography is included. (MJM) 
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COLLEGE GOALS AND THE CHALLENGE OF EFFECTIVENESS* 



Some New Higher Education Realities 

1 will not be the first to assert that higher educa- 
tion in America has reached a watershed. For 20 
years, in most of the 50 states, we have seen 
extraordinary expansion in higher education 
programs and facilities. This growth has been 
associated with an unquestioning belief that 
economic and social progress is a natural conse- 
quence of higher education. All this, for many 
reasons, has now changed. 

Various forecasters generally agree that, due to 
declining birth rates, enrollment increases will be 
slowing down during the 1970s and that the 
1980s will be a decade of zero population 
growth in American higher education (2). Add 
to this a decreasing desire to attend college on 
the part of those we can call, as a shorthand, 
members of the counter-culture. The extent to 
which youths alienated from standard American 
institutions will opt for some kind of life other 
than an academic one is most difficult to fore- 
cast; this factor has certainly not entered into 
any of the existing predictions. My own hunch is 
that their numbers will increase and that they 
will be among those we used to think of as our 
best, our most intelligent and sensitive students. 
Furthermore, I expect the new college students 
in the 1970s will tend to be from the working 
classes and possess relatively lower levels of 
scholastic ability (3). 

A second general factor pushing us toward the 
watershed has been mounting public displeasure 
with the universities, a result largely of student 
radicalism and campus disorder. Antagonism 
reached a peak in 1970 in the wake of campus 
upheavals following the invasion of Cambodia 
and the shootings at Kent State University. As 
many of us will remember, the fires of resent- 
ment were fanned briskly by various politicians 
pursuing their political fortunes during off-year 
election campaigning. Taxpayers grew increas- 
ingly reluctant to have their money used to 
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support colleges and universities that, they felt, 
were unable to maintain internal order and that 
seemed to be staging grounds for various subver- 
sive actions. One should be careful, however, not 
to overgeneralize the extent of public reaction. 
Colleges in some parts of the country and some 
kinds of colleges throughout the country-two- 
year and church-controlled colleges, for exam- 
ple, which have experienced little disorder-have 
less often been the objects of public animosity. 

Third and most important are the present 
economic realities. The country finds itself in 
the grip of both inflation and recession. The cost 
of goods and services has risen steadily for some 
years. More recently, the economic downturn, in 
addition to meaning fewer jobs for college grad- 
uates, has meant urgent and probably undeni- 
able claims on public coffers for expenditures 
such as welfare payments and unemployment 
insurance. To these rising general costs of gov- 
ernment is added the apparent fact that public 
revenues have about reached their limits of avail- 
ability. I say "apparent" because it is hard to 
know what the real situation is, and we do know 
that there is much room for reform in revenue 
and tax systems. Yet there is no doubt that 
elected officials, in a time when the cost of liv- 
ing has been rising relentlessly, are most reluc- 
tant to saddle their constituents with higher 
taxes. The result is that governments at all levels 
are experiencing a cost-revenue squeeze. Many 
state governments in particular are finding that 
their revenue pools are smaller than expected 
and must be parceled out among diverse state- 
supported programs, including those for higher 
education, all of which are typically asking for 
budget increases. This situation has created what 
Byrnes and Tussing call The Resource Gap"~- 
"the difference between available resources and 

needed resources'^!)- 
To be sure, enrollments co//////W£' to increase at 

most public colleges and universities (11), but so 

do the numbers on welfare and unemployment 

insurance rolls and there are strong pressures for 

totally new state programs such as medical care, 

prison reform, a.nd improvement of the physical 



LMivi roil men t. In summary, the new economic 
realities, the slowdowTnin^ college enrollments, 
and the lingering animosity toward the universi- 
ty in some localities have combined to under- 
mine the rather enviable position that state high- 
er education systems over the years had come to 
enjoy vis-a-vis other state-supported activities. 

How are public officials responding to these 
new circumstances? Some, perhaps many, are re- 
acting irresponsibly due to hopes for political 
gain, lack of knowledge, or outiight hostility. 
We have seen this in California-hiring freezes, 
investigations of faculty work loads, special 
audits of a variety of university operations, and, 
very recently. Governor Reagan's line-item veto 
of faculty raises. This kind of simplistic and 
sometimes vindictive action may also be occur- 
ring in other states around the country. 



The Challenge of Effectiveness 

But emerging from a good many state capitals is 
another kind of reaction to the general fiscal 
dilemma, one that seems to be rather more 
responsible. This position recognizes the fierce 
competition for the tax dollar, but asks for rea- 
sonable and constructive accommodations on 
the part of all concerned interests. The basic 
criterion used in reaching these accommoda- 
tions, in finally determining which programs will 
receive what share of the public dollar, is refer- 
red to as program effectiveness. 

Most people who talk about effectiveness do 
not know precisely what they mean by it. The 
rhetoric often used to express it is **How can we 
get more mileage from the higher education dol- 
lar?" or the "law enforcement dollar?" or what- 
ever. Very often effectiveness in higher educa- 
tion means little more than enrolling more stu- 
dents or awarding more degrees without increas- 
ing operating budgets. But, however expressed, 
the crux of this stance is that limited public 
revenues are to be allocated among various gov- 
ernmental programs according to some criterion 
of demonstrated or anticipated effectiveness. 

I believe that, by and large, responsible public 
officials will welcome the participation of aca- 
demic people in articulating the purposes and 
values of higher education, in defining the roles 
of the different campuses in the state, in deline- 
ating standards of effectiveness, and in otherwise 



reaching accommodations on (he amount of 
available money. 1 realize that the best inten- 
tions of our most responsible public servants arc 
often mutilated in the give-and-take of state- 
house politics. Nevertheless, the challenge of 
effectiveness is a very real one and, though 
crudely conceived in some of its details, it is an 
appropriate, fair solution to the fiscal problem 
and deserving of constructive response from the 
campu.ses. 



Tlie Response from the Canipu.ses 

How should the campik^s and systems of higher 
education in the state respond to this challenge 
for solution? First of all. academic communities 
should take the initiative, through hig1i-profilc 
leaders, in propo.sing terms by which acconuno- 
dations may be reached, rather than sit back and 
let conservative legislators and statehouse budget 
cutters go into action on their term.s. In almost 
any negotiation, the party that first puts for- 
ward a conceptual framework, a set of princi- 
ples, and a vocabulary that may be used in the 
ensuing di.scu.ssions has a clear tactical advan- 
tage. Thus, at the outset, college leadens should 
try to establish a conceptual context for sub.se- 
quent discussions, offer to cooperate with other 
campuses and agencies in laying plans, and make 
clear that their staff members are preparing 
evidence and proposals that will be ready on a 
firm date. 

Once this initiative is taken, things have to 
start happening on the campu.ses and in the 
coordinating bodies (in .states where they exist). 
Colleges must organize to plan and justify their 
future in the face of limited financial resources. 
People in all units or programs at each institu- 
tion will need to define their objectives and 
devise methods for determining the extent to 
which these objectives are being realized. In 
other words, procedures for evaluating the effec- 
tiveness of programs must be worked out. Col- 
lege leaders will then have to learn how to com- 
municate evidence of effectiveness cogently to 
those who, in the final analysis, decide how the 
money is to be distributed. 

A climate of active support and ready partici- 
pation is essential to the success of these plan- 
ning and evaluation activities, and it presents 
another challenge to college leadership. Faculty, 



especially, must be convinced of the need lor 
systematic planning and full cooperation (7). 
Everything in both the central offices and the 
departments must be absolutely open and above- 
board use of discretionary funds, projected 
staffing arrangements, and budget figures are 
good examples. Many will say that 1 am ignoring 
present-day realities of academic life, that pro- 
fessors don't just preach academic freedom - 
they practice it, that administrators are not to 
be trusted, that information is selectively distrib- 
uted, that paranoia runs rampant, and that this 
uneasiness is intensified by pressures from above 
to cut back. Maybe so, yet at some campuses the 
fiscal squeeze has reached crisis proportions, and 
the people there have little choice but to lay 
aside old animosities and get themselves togeth- 
er. No college president interested in keeping his 
job is going to go to the state capital or the 
statewide coordinating body with a plan that 
many on his campus do not accept. On the other 
hand, the campus that presents no plan and gives 
no evidence of concern about institutional effec- 
tiveness runs the risk of soon marching to a new 
drum, of being told not only what is to be 
taught, but how and when it is to be tauglit. 

Absolutely critical to a college's planning, eval- 
uation, and related institutional-renewal activi- 
ties is a consciousness among people on the cam- 
pus of the goals of the institution. Planning 
makes no sense unless the planners know what 
ends they are seeking to realize or maximize. 
Program objectives have coherence to the extent 
that they reflect broader institutional goals. 
Assessment of institutional effectiveness is most 
sensibly understood as determination of the ex- 
tent to which acknowledged goals are being 
achieved. Indeed, one could conclude that no 
decision on the campus makes sense unless it is 
taken with reference to accepted college goals. 
Beyond these rather pragmatic uses, such goals 
are the fundamentals of an institution's /?o//o% 
ideology, and values, providing a focus for loyal- 
ty, professional commitment, and genuine com- 
munity. 

Research on Institutional Goals at 
Educational Testing Service 

One of the important missions of Educational 
Testing Service is to provide instruments and 
services for assessing individuals and educational 



programs, with the latter receiving increasing 
attention. Thus, some three to four years ago, 
several of us engaged in research in higher educa- 
tion at ETS began to think about developing a 
tool that colleges could use to articulate goals 
that would give focus lo subsequent assessment 
activities. 

Late in 1969, a preliminary Institutional Goals 
Inventory (IGI) was assembled for use in a study 
conducted by Norman Uhl with the cooperation 
of five institutions in the Carolinas and Virginia 
and sponsored by the National Laboratory for 
Higher Education. One purpose of the study was 
to test the value of the Delphi Technique (6) as 
a method for achieving consensus among diverse 
constituent groups regarding institutional goals. 
With some interesting exceptions (goals relating 
to religious emphasis and personal freedom), be- 
liefs about goals generally did in fact converge, 
with repeated administrations of the inventory 
along with feedback of results ( 1 2, 23, 14). 

Early in 1971, this writer, working with Barry 
Morstain, Acting Director of Academic Planning 
and Evaluation at the University of Delaware, 
undertook a substantial modification of the pre- 
liminary instrument and arranged for administra- 
tion of the resulting form, in April, to samples 
of students and faculty at 10 colleges and uni- 
versities on the West Coast. Details of the revi- 
sion of the theoretical framework and item con- 
tent and the organization of the cooperative 
pilot study aie described elsewhere (10). Follow- 
ing the format used by Uhl and earlier by Gross 
and Grambsch (5), respondents to each of the 
1 10 goal statements in the 1971 Revised Experi- 
mental Form made both Is and Should Be rat- 
ings along a five-point scale; that is, they indi- 
cated their perception of how important the 
goal currently is on the campus and also their 
opinion about how important xi should be. 

Groups of five goal statements were scored to- 
gether (mean of the five items means calculated) 
to give Is and Should Be scores for 22 "goal 
areas." These 22 concepts- 13 "output goals" 
and 9 "process goals"-comprise the theoretical 
framework referred to above; it represents an 
attempt to conceptualize in a meaningful and 
useful way the spectrum of goals of American 
colleges and universities in the early 1970s. 

W»" expect frequently-perhaps every two 
years-to update both the conceptualization and 



item content of the IGI. The form pubhshed by 
ETS m the spring of 1972 is changed somewhat 
from the 1971 version. While the new operation- 
al inventory embraces the same 13 **output 
goals" (as shown in Figure 1), it covers only 7 
''process goal" areas, one of which is wholly 
new. Process goal titles are Freedom, Democrat- 
ic Governance, Community, Intellectual/ 
Esthetic .Environment, Innovation, Off-Campus 
Learning (new), and Accountability /Efficiency. 
The 1972 IGI contains 90 goal statements-four 
each for the 20 goal areas and 10 miscellaneous 
goal statements, including two items from each 
of the three goal .areas that were dropped. The 
instrument also has space for rating up to 20 
additional goal statements written by local cam- 
pus people to cover goals of special relevance to 
the institution not included in the inventory. 

On the following pages, selected results from 
the 1971 pilot study are given-mostly in the 
form Of profiles of scores across the 22 goal 
areas of the experimental inventory for specified 
campus constituent groups. 

Illustrative Results from the West Coast Pilot 
Project. Figures 1 and 2 give the IGI profiles for 
all the faculty and all the students, respectively, 
participating in the 10-college pilot study. These 
four profiles provide a kind of normative con- 
text against which to consider the profiles for 
the individual colleges. 

One notes, first, a normative discrepancy be- 
tween Is and Should Be judgment for both 
faculty and students, in every goal area with the 
exception of Traditional Religiousness, and, for 
faculty alone, the exception of Collegiate Envi- 
ronment. 

In general, the Is profiles for faculty and stu- 
dents are similar. The students seem to have mis- 
perceived somewhat the importance of advanced 
training and research at their institutions, only 
one of which is a university. The Should Be re- 
sults for the two groups, however, are different 
in several interesting ways: Faculty attach slight- 
ly greater importance to the academic and intel- 
lectual development of students and less impor- 
tance to the development of their personahty 
and values; students give much greater emphasis 
to vocational preparation, attach greater impor- 
tance to the socially oriented goals (Puolic Serv- 
ice, Egalitarianism, and Social Criticism), and see 



greater value in a traditional collegiate. 
College" environment. 
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Figur* 2 
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Figures 3, 4, and 5 depict goal-beliefs for 
faculty and students at a liberal arts college for 
women in California. Most striking in Figure 3 is 
the closeness of the Is and Should Be profiles. 
The 51 faculty respondents appear to be reason- 
ably satisfied with the existing intellectual- 
nonvocational goal structure of the college as 
they understand it. Indeed, the Is profile is 
generally well above the 10-college faculty 
norm. 

Figur* 3 
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The students at the college, however, are less 
sanguine about the college's present goals (Fig- 
ure 4). Should Be-Is discrepancies, in conse- 
quence, are larger. In particular, compared to 
the faculty, the students do not place as much 
importance on student development, either cog- 
nitive or noncognitive, or on the process goais of 
Freedom, Democratic Governance, Community, 
and Intellectual/Esthetic Environment. 

When the Should Be profiles for the faculty 
and students at the college are lined up together 
(Figure 5), the potential for conflict between 
the two constituencies about college goals comes 
into sharp focus. Compared to the faculty, the 
students want somewhat less emphasis on purely 
academic work, they want the college to assume 
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Figure 5 
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a more socially active, less '^ivory-towerisir' pos- 
ture, and, most important, they want vocational 
training, including advanced professional train- 
ing, in which the faculty are generally disin- 
clined to have the college engage. 

In Figure 6 are the Should He profiles for sam- 
ples of faculty, students, and administrators at a 
large state university in the Northwest. The few 
differences between the three groups are general- 
ly understandable, given the prevailing stereo- 
types. Thus, the students stand relatively high 
and the faculty low on the noncognitive student 
development goals, faculty low on the socially 
oriented goals, and administrators high and fac- 
ulty low on the accountability process goal. 
Interestingly, this sample of students was as sup- 
portive of university research as were the faculty 
and administrators. 

Fiflurt 6 
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The independent liberal arts college profiled in 
Figure 7 has an historic tie with the Presbyterian 
Church and is the one institution in the study at 
which trustees filled out the IGI. Again, many of 
the differences in the Should Be ratings could 
perhaps have been predicted: faculty high on 
cognitive learning goals, trustees low on two of 
the three noncognitive learning goals, trustees 



relatively high on the Religiousness goal, stu- 
dents high and trustees low on the socially ori- 
ented goals, especially Egalitarianisni and Social 
Criticism, and trustees low on Freedom and high 
on Accountability/Efficiency. 

Figure 7 
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Is and Should Be ]W(3igmmX^ of the faculty at a 
California junior college are shown in Figure 8. 
To some extent, the output goal Is profile re- 
flects common understanding about the role of 
the public junior college, althougli the Is score 
on Vocational Preparation is not a great deal 
higher than the lO-college norm (which includes 
only one public junior college), and the teaching 
goals (1 through 5) are not receiving the stress 
that might have been expected. Meeting Local 
(community) Needs and Social Eg^litariaijism 
(as manifested, for example, by open admis- 
sions) are seen by the faculty as relatively impor- 
tant goals, as one would expect at a public jun- 
ior college. 

Of significance in Figure 8 are the numerous 
sizable Should Be-Is discrepancies. With regard 
to the output goals in particular, this faculty 
would have the college do much more in the 
areas consistent with the public junior college 
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ctlios-give greater stress to the various teacliing 
goals, do much more in tlie way of vocational 
preparation of students, and engage more in 
public service and socially oriented activities. 
Also important are the several large discrepan- 
cies in the process goal profiles. The faculty 
seems to be longing, in particular, for a college 
environment charactenzed by a stronger sense of 
community (expresse<i as interpersonal trust, 
openness of communication, and so forth), intel- 
lectual excitement, and innovation. Compared 
with some of the faculties studied, notably 
public university professors, this faculty also 
welcomes increased systematic evaluation of col- 
lege programs and efforts to implement institu- 
tional accountability. 

Figure 0 
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Profiles for State College Constituencies. Figures 
9 and 10 give the and S/ioi/W Be profiles 
respectively for faculty and students combined 
across the three state colleges in the sample, as 
well as profiles for a sample of 48 presidents of 
member colleges attending the 1971 Summer 
Council of the American Association of State 
Colleges and Universities at Black Hills State 
College in Spearfish, South Dakota. A simpler 
scoring method was used with these data be- 



cause the responses of the pi ^>ulents had to be 
hand-scored. Mean percenlai^LS rather than 
means of the item means were calculated. The 
two scoring method's yield sseniially the siime 
profiles, that is, the same rank-ordering of 
scores. The mean percentage method uses only 
the two highest of the five possible ratings tor 
eacii item. Thus, for a given group of respond- 
ents, the percentage of the group answering 
either Of Exircnwly High Imporiame or Of 
Very High Imporiance is computed for each of 
the five items in a given goal area (for example. 
Academic Development) and then the mean of 
those five percentages is calculated. In fact, all 
25 constituent groups (students, faculty, admin- 
istrators, and .so on) across the 10 colleges were 
scored both ways originally. For each of the 25, 
a rank-order correlation was computed between 
the tVi/o sets of Is scores and the two sets of 
Should Be scores. The mean of th« 50rho\s was 
.97; the lowest was .89. 



emu. rttoti^ut rfttiltr 



2, UlrtUciutl l)rl<>i«l'lto« 

«. UMMil^/jLltrvlftu 

4. Tt441ll^4l Wlls>«u»>vi»*' 

7. Vot<ll««'} rtvMl^tlvw 



9. y^%*»itU 

11. r^ttiu s^ivKc 

12. Social tr<):tdrl.MUM 
11. f^ttl Ctt\l''\tM/ft\i' 



14, Itr*'^^ 
14. C»Mw«liy 

17. Ul.n»4lu*l7f»lt-'il* '»>vH 
It, iiVf-V't ton 

72, Iklwtfu) k> 




The student and faculty Is profiles shown in 
Figure 9 tend to be somewhat lower than the 
respective 10-college norms (based on mean per- 
centage calculations not illustrated in Figures 1 
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and 2). The relatively low oiitpiH^dal scores 
suggest that, insofar as faculty and stiidents are 
concerned, their institutions have no distinct 
mission that no special emphasis, compared to ^ 
the other kinds of institutions, is placed on any 
of the kinds of output goals covered in theJCil— 
Specifically, the state college faclilt>»-'?.v scores ^ 
were relatively low for the first fivc^tudent- - 
development goals, for Advanced Training, and. * 
by generally large margins, for process goals 14.*- 
15, 16. 17. and 19. The lone scpa' above the 
norm was for Accountability/l-fficiency. Siu--^ 
dent /.V scores, notably similar to those of thciK 
professors, were furthest below the lO^fiMege 
student norms on goal^areas 3, 4, 5. H. and llv^- 
They stood above the^*norm only on goal yrea 
1 8-Collegiate Environment. ^ ^ 

The Av profile of the state college* presidents on 
the IGl (Figure 9) tends to lie above those for* 
both faculty and students. The presidents;mer-_ 
haps have a more idealized and naturatry ego-'' 
involved view of their campuses. Stdl^onf^i^^^' 
wonder what the reality of the sUuii^n is, <Jir=*^ 
whose version of reality is **truest", regarding, 
say. Academic Development. . Freedom, and 
Democratic Governance. 

The administrators at the university depicted 

m Figure 6 had Is scores above faculty and stu-"^ 
dents on 20 of the 22 goal areas. Administrators 
also tend to score above faculty and students on 
ETS's Institutional Functioning Inventory (tFI). 
an instrument developed by the Higlier Educa- 
tion Research Group to help illuminate how fac- 
ulty, students, and administrators perceive an in- 
stitution's current administrative policies, teach- ^ 
ing practices, and academic and extracurn^^ 
programs. On the other hand, studwtfiU^^aliy^^"^ 
(and naturally, one supposes) score ^xelatively p 
low on the Freedom and Democratic Govern- 
ance variables, which are contained in both the 
IGl and the IFL 

The Should Be profiles (Figure 10)- for state 
college faculty and students are quite similar to 
the respective norms (faculty are somewhat low^ 
only on Social Egalitarianism and Account- 
ability/Efficiency); the discrepancies between Is 
and Should Be judgments, consequently, are rel- 
atively large. These people seem to be saying. . 
that they would like to see much^about their 
colleges changed. " ' 

But if these faculty and studenls-discontenP" 



ed, frustrated, idealistic see nnich room for 
change, the pre>idents want something akin to a 
whole new order. Tin .r average Should Ifc-ls dis- 
crepancy i> larger than that of any eonstitucnt 
group at any college in the spring study. These 
pa^sidents (with the facully) want their institu- 
^ous to maximize the academic and inlellcctual 
development of undergruduates. (with the stu- 
dents) to give iiioa* attention to their develop- 
ment as complete persons, (with the students, 
but. importantly, less no with the faculty) to 
stress vocational preparation, (with the faculty, 
happily) noi to eniphasi/e research and ad- 
vanced training, and (more so. typically, than 
the faCMlty.) to become more engaged in commu- 
nity service and social action. As regards the pro- 
cess goals, the presidents yearn for something of 
an organisational Utopia: a genuine community, 
democratically governed and intellectually excit- 
ing, characterised by innovation, evaluation, 
planning, accountability, and good relations 
with off-campus interests* 



ivtttJi tio^ 



I. V««allv4Hl 

r*...a«t ^t* 

U. ii^ 
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Reporting Strategies. There are other ways* be- 
yond simply plotting profiles, for organizing 
data ft-om the IGl. For example, using data from 
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the college depicted in Figure 7, Table I gives a 
rank-ordering of Should Be scores for the three 
constituent groups at the college. In the right- 
hand column is a goal-priority ranking for the 
three groups combined, which assumes an equal 
voice for each group in establishing priorities. 



Different weights, of course, could be assigned 
to the different constituent groups, if deter- 
mined to be appropriate; such determination* 
however, would reflect rather critical assump- 
tions or decisions about how authority is to be 
distributed on the campus. 



TABLE 1: IGI GOAL RANKINGS FOR THREE CAMPUS CONSTITUENT GROUPS 
(An independent liberal arts college) 







Faculty 


Students 


Trustees 


Combined 








78} 


(N=90) 




Constituencies 




Output Goal Areas 


Should Be 


Rank 


Should Be 


Rank 


Should Be 


Rank 


Should Be 


Rank 


1. 


Academic Development 


4.01 


6 


3.72 


10 


Ail 

3.46 


1 r\ 
ID 


1 1 10 
1 1 .IV 


7 ^ 
/ .J 


2. 


Intellectual Orientation 


4.41 


1 


4,14 


1 


A C\0 








3. 


Individual/Personal Development 


3.93 


7 


3.92 


6 


3.9o 


J 


1 1 U 1 
1 1 .o 1 


J 


4. 


Humanism/Altruism 


4.12 


4 


4.U4 


5 


J.JO 


1 7 
1 / 




u 


5. 


Cultural/Esthetic Awareness 


3.34 


1 1 


3.53 


1 1 




1 c 
ID 


0 R 1 
V.o 1 


1 J 


6. 


Traditional Religiousness 


2.07 




2.M 


22 


2.74 


16 


6.85 


22 


7. 


Vocational Preparation 


2.82 


17 


3.32 


14 


3.15 


12 


9.29 


14 


8. 


Advanced Training 


2.06 


21 


3.12 


17 


2.57 


18 


7.85 


20 


9. 


Research 


2.31 


20 


2.69 


21 


2.11 


22 


7.1 : 


21 


10. 


Meeting Local Needs 


2.93 


15 


3.28 


15 


2.98 


14 


^M9 


15 


11. 


Public Service 


2.77 


18 


3.07 


19 


2.47 


20 


8.31 


19 


12. 


Social Egalitarianism 


2.85 


16 


3.17 


16 


2.51 


19 


8.53 


18 


13. 


Social Criticism/Activism 


3.15 


13.5 


3.47 


12 


2.40 


21 


9.02 


16 




Process Goal Areas 


















14. 


Freedom 


3.76 


9 


3.90 


7 


3.31 


11 


10.97 


10 


15. 


Democratic Governance 


4.05 


5 


3.95 


5 


3.82 


6 


11.82 


4 


16. 


Community 


4.25 


3 


4.06 


2 


4.44 


1 


12.75 


1 


17. 


hi tellec tual/ Esthetic Environmen t 


4.30 


2 


3.98 


4 


3.95 


4 


12.23 


3 


18. 


Collegiate Environment 


2.63 


19 


3.00 


20 


3.13 


13 


8.76 


17 


19. 


Innovation 


3.80 


8 


3.88 


8 


3.47 


9 


11.15 


9 


20. 


Evaluation and Planning 


3.68 


10 


3.84 


9 


3.67 


7 


11.19 


7.5 


21. 


Accountability/Efficiency 


3.15 


13.5 


3.34 


13 


3.93 


5 


10.42 


11 


22. 


External Relations 


3.26 


12 


3.08 


18 


3.65 


8 


9.99 


12 



Another strategy for using IGI data in setting 
priorities, illustrated in Table 2, involves consid- 
ering not just tlie Should Be scores but also the 
size of the discrepancy between Is and Should 
Be ratings. In deliberating, for example, how 
resources are to be allocated, one could argue 
that both what people want the college to 



accomplish (the Should Be ratings) and how far 
the college has to go to get there (the Should Be-Is 
discrepancy) are important. The Should Be plus 
discrepancy analysis could be repeated with other 
campus constituent groups and a priorities rank- 
ing computed that reflects both factors {Should- 
Be and discrepancy) across all constitutencies. 



I! 



TABLE 2: "SHOULD-BE PLUS DISCREPANCY" GOAL RANKINGS 
(Independent liberal arts college faculty: N=7S) 





Output Goal Areas 


I. 


Academic Development 


2. 


llll\«ll(^Vluul WlitllliltlUll 


3. 


I nd ividu al/Pe rsonal Develo p me n t 


4. 


Humanism/ Altruism 


5. 


Cultural/Esthetic Awareness 


6. 


Traditional Religiousness 


7. 


Vocational Preparation 


8. 


Advanced Training 


9. 


Research 


10. 


Meeting Local Needs 


II. 


Public Service 


12. 


Social Egalitarianism 


13. 


Social Criticism/ Activism 




Process Goal Areas 


14. 


Freedom 


15. 


Democratic Governance 


16. 


Community 


17. 


Intellectual/Esthetic Environment 


18. 


Collegiate Environment 


19. 


Innovation 


20. 


Evaluation and Planning 


21. 


Accountability/Efficiency 


22. 


External Relations 



Is Should Be Diserepancy 

3.16 4.01 0.85 
2.97 4.41 1.44 

2.89 3.93 1.04 
3.20 4.12 0.92 

2.90 3.34 0.44 
2.15 1.97 0.18 

2.32 2.82 0.50 
1.90 2.06 0.16 
1.90 2.31 0.41 
2.41 2.93 0.52 

2.17 2.77 0.60 
2.12 2.85 0.73 
2.40 3.15 0.75 

3.33 3.76 0.43 

2.87 4.05 I.I8 
2.96 4.25 1.29 

3.18 4.30 1.12 
2.82 2.63 0.19 

2.88 3.80 0.92 

2.94 3.68 0.74 

2.95 3.15 0.20 
2.80 3.26 0.46 



Shouh! lie * 

Should Be Diserepaney Diuiepamx 



Rank Rank Rank 

Order Order (hdcf 

4 4 

1 I I 

4 2 3 

2 3 2 

5 10 6 
13 12 13 
9 9 10 

i: 13 12 

11 II II 

7 8 8 
10 7 c) 

8 6 7 

6 5 5 

5 7 6 

3 2 3 
2 I I 
I 3 2 

9 9 9 

4 4 4 

6 5 5 
8 8 8 

7 6 7 



Ah;o, one might argue that output and process 
goals are fundamentally different things and that 
they ought not to be ranked together. Table 2 
has the two categories ranked separately. 

Finally, since item response distributions by 
frequency and percent are included in the stand- 
ard IGI score report from ETS, colleges can 
analyze the responses to individual items in the 
inventory. An example for the Figure 7 college 
is illustrated in Table 3. 



Planning for Effectiveness: Brief Notes 

Setting goals. I have tried to stress that institu- 
tional effectiveness is best understood in terms 
of the degree of achievement of accepted institu- 
tional goals and program objectives. In the pre- 



vious section, I discussed a strategy by which a 
college community can articulate the beliefs its 
present members hold about goals for the insti- 
tutions. These understandings are essential to 
the goal-setting process; at most private colleges, 
which still outnumber public ones, such internal 
beliefs are perhaps sufficient. However, in deter- 
mining goals at public institutions, at least two 
other general factors must enter in. 

First, it seems in the nature of a moral impera- 
tive that public taxpayer-supported colleges and 
universities be responsive to the educational 
needs of their taxpayer constituency. Put this 
way, few would object. Yet, one wonders to 
what extent the educational interests of citizens 
are considered in the deliberations of various 
academic senates, curriculum committees, and 
long-range planning groups. Indeed, assuming 



TABLE 3: PROPORTIONS INDICATING THE GOAL TO BE EITHER 
OF EXTRFMEl. YIUGH IMPORTANCE OR OF HIGH IMPORTANCE 



26. To provide opportunities for stu- 
dents to receive training for speci- 
fic occupational careers, such as 
accounting, engineering, and nursing. 

86. To excel in intercollegiate 
athletic competition. 



Is 

Should Be 



Is 

Should Be 



Facultv 



2U 



24 
9 



Students 
(X=90l 



107c 
51 



26 
II 



Trustees 



0?^ 
36 



18 
18 



their importance is recognized, how can the 
educational interests of area taxpayers become 
known? One important way is through market 
research. Colleges and universities or regional 
systems could survey the adults in their regions, 
focusing particularly on high school seniors, to 
determine what sorts of educational programs 
they would take advantage of from the stand- 
point of content and method of instruction (on 
or off campus, for example). Historically, of 
course, the specialized interests of the professors 
on hand have probably exerted the most influ- 
ence on developing new courses and programs, 
but the influence of external interest groups has 
also been a major factor. 

I can see it now: The owners of the funeral 
parlors in the county are talking together over a 
cadaver about how much money they're not 
making because they have to train their own 
undertakers. One says, '*Hey, maybe we can get 
the state college over in Dranconia to set up a 
program; they could call it 'mortuary science' if 
they want." And another says, ''Great idea. And 
say, one of the trustees of Dranconia State goes 
to my church, for Chris' sake. Til sound him out 
about it.*' And on it goes from there. Curricu- 
lum development solely in response to external 
interest-group pressure, like putrefaction, is 
probably intolerable. However, if 200 or 300 
people in Dranconia's regional market survey say 
they are interested in becoming embalmers. 
maybe their educational need should be met. 

For institutions that are part of regional or 
state systems, yet another factor in establishing 
institutional goals will be the broad conception, 
set forth at levels above the individual campus. 



of the kinds of higher educational activities that 
are to be carried on across the region or state. 
Development of "master plans" and assignment 
of "missions" to "component campuses" is the 
stuff by which "superboards" live. One may 
hope that they do their work democratically and 
rationally, giving attention to human as well .tS 
v^.'onomic, political, and other considerations. 
Coordination, when sensible, is in the public 
interest, and it is proper that the goals ot' each 
campus in the system in part reflect regional and 
state plans (8). 

In sum, goal setting at the public institutions 
should involve integrating the desires of people 
on the campus with those of the citizens in the 
region and the statewide planners. Higli orders 
of academic statesmanship will be required at 
several levels to reach goal accommodations rea- 
sonably satisfying to all involved. 

Organizing to plan. In recent years, planning 
methodology has become a specialized and tech- 
nically refined field, as anyone on the mailing 
list of the National Center for Higher Education 
Management Systems at WICHE can appreciate. 
Large corporations, and. more notably, the 
Defense Department under McNamara. have 
made good use of professional planners. Mo.st 
are products of university economics depart- 
ments. A good many exgovernment planning 
specialists have since fanned out into the univer- 
sities, taking along their PPBS's., operations 
research techniques, computer simulation mod- 
els, and so forth. University of California Presi- 
dent Charles Hitch and numerous others on his 
staff, for example, are of this school. 
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Of course, business and military planning mod- 
els are not entirely suited to academic settings, 
where the people affected are typically less than 
enthusiastic about their working lives becoming 
subject to bureaucratic plans. Again, it is up to 
campus leaders. Arrangements must be created 
enabling participation in the planning process by 
all who want to be, or can be cajoled into be- 
coming, involved. Broad participation in institu- 
tional goal setting is realized througli the use of 
an instrument such as the Id. I do not suggest 
that planning will not mean constraints. It will. 
The really important point is 'that the con- 
straints be decided upon througli democratic 
participation. 

Participation not only helps to legitimize the 
plans, it has the potential for improving their 
quality, their goodness. Planning can perhaps be 
simply defined as the process by which means 
are specified for reaching predetermined ends, 
^"hat is needed are ideas about means, and the 
more people actively contributing such ideas, 
the greater the likelihood of a number of really 
good ones finding their way to the surface. 

Most campuses of any size will need a more or 
less formally organized, ongoing planning group 
or office. Its staff would include specialists in 
budgeting and financial planning, in managing 
large masses of information, in using computers, 
and so forth. It should also include idea men and 
women on a continuing basis: a full-time direc- 
tor; two or three professors on a yearly rotating 
basis, released half or two-thirds time from their 
departments; a like number of students, rotating 
yearly and paid for their time; and a professor or 
an administravor on leave from some other cam- 
pus, preferably one with a recent history of 
successful planning. Two kinds of people are 
needed: idea men who can raise questions and 
speculate about possibilities and can-do men 
who can get the answers. 

Setting program objectives. In contrast to insti- 
tutional goals, which may be conceived in fairly 
broad terms, the program objectives of the vari- 
ous organizational subunits of a campus- the 
depavtments, counseling center, alumni affairs 
office, and so on- need to be defined narrowly 
and precisely. Ideally, definitions of objectives 
should be operational, indicating clearly how to 
measure how successful the program has been in 
reaching its objectives. "Measure" can include 
many different kinds of operations; most often, 
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it has meant merely simple count.s: How man\ 
alumni gave how many dollars during the year, 
how many books were checked out of the li- 
brary, how many graduates got jobs through the 
placement center? These particular example^r- 
suggest that in the nonacademic or noninstruc- 
tional units of the campus, it may be fairly ea.sy 
to define program objectives operationally. 

But it is usually extraordinarily difficult to do 
so in the departments, unless one is satisfied 
with counts-unless, for example, the maiir 
objective of the psychology department is to 
graduate as many students in psychology as it 
can. Ordinarily, departments try to grow as large 
and attract as many students as they can. Cer- 
tainly this must be one of the elementary princi- 
ples of academic life. But then we're talking 
about reputation and power bases, not about 
objectives-at least not about instructional or 
learning objectives. 

What makes the delineation of learning objec- 
tives so difficult, of course, is that they cannot 
be discussed without discussing the details of the 
curriculum. Properly, I think, a curriculum 
should be based on a set of learning objectives. 
The men and women in the department should 
first set forth the objectives and then proceed to 
build a curriculum to maximize those objectives. 
However, we could probably count on two 
hands the number of times it has ever worked 
out this way in American universities. My im- 
pression is that deliberations about departmental 
curriculums have become so fraught with anxie- 
ties (about "my course" being eliminated) that 
the general topic is just not much talked about 
in university departments anymore. Talk about a 
challenge to leadership! 

One suggestion I have about setting instruc- 
tional objectives is that departments consider 
casting their objectives in the form of questions 
or exercises in a comprehensive departmental 
examination. In large departments or schools 
with several subspecialties, there could be several 
examinations. The idea is that some level of per- 
formance on the test would be required for grad- 
uation. This brings us to the problem of defining 
effectiveness. 

Defining Effectiveness 

There are at least five ways that colleges can 
usefully conceive of institutional effectiveness. 



Each approach lends itself to fairly ready meas- 
urement (4. 9). 

But before gettuig into tliese, I want to dis- 
pose of a semantic problem that has been both- 
ering me. Quite frequently we hear academic 
statesmen speak about "quality," or "institu- 
tional quality." Leaders at my alma mater. 
Berkeley, are voicing concern about a decline in 
the quality of the university as a result of budget 
cuts; others, in New York perhaps, are concern- 
ed about "educational quality" being diluted by 
a systeiii^of external degrees. 1 would like to 
think that "effectiveness" and "quality" mean 
the same, that an institution that is effective, 
according to one or more of the criteria to be 
outlined, also has quality or is of high quality. 
Yet people who speak about quality usually 
have in mind such things as granting admission 
only to the most academically able students, 
conducting instruction as much as possible at 
correspondingly high levels, and maintaining 
prestigious graduate departments staffed by Ivy 
League PhD's and Nobel laureates. Traditional 
and elitist, this notion of quality has little bear- 
ing on any of the definitions of effectiveness 
that I am presenting here. To be sure, a star- 
studded faculty will attract many talented grad- 
uate students. Yet the job market for new PhD's 
being what it is, production of many first-rate 
PhD's may be a somewhat hollow index of effec- 
tiveness. 

(I) Student learning,. The first and the most 
important criterion of institutional effectiveness 
is how nruch of what the college wants its stu- 
dents to learn they, in fact, do learn. To find 
out, some kind of comprehensive examination 
would be needed. It could be made up of tests 
of specialized knowledge (to which I alluded 
earlier), of general knowledge across the sciences 
and humanities, of something daring like gener- 
alized problem-solving ability, or, even more 
reckless, of the basic skills of reading, writing, 
,and arithmetic. Remember, we are not interest- 
ed in the absolute level of test performance, 
except, perhaps, to determine who gets degrees; 
our interest, instead, is in test gains. A test of 
specialized knowledge would be given to stu- 
dents at the time they begin their major field 
work; the others would be taken at the begin- 
ning of the freshman year. All would then be 
repeated at the end of the senior year. It*s the 



old idea of senior coniprehensives. Institutions 
in multicanipus systems could usefully use a 
common set of examinations, cooperatively con- 
structed by people from the several campuses. 

(2) Student values development. If asked about 
it. most people on most campuses. 1 think, 
would say that the college ough| to have some 
impact on the values, attitudes, and commit- 
ments of students. In some way or another, they 
should be better people by the time they leave 
the campus-the public college campus included. 
While tests in these areas are by no means as 
refined as available academic examinations, 
there are measures of qualities such as social 
conscience, moral development, and altruism 
that are fairly widely used and could be included 
in both the proposed freshman and senior com- 
prehensives. Some legislators would be im- 
pressed by data that show no more than that 
students do not become more cynical about 
American political institutions after four years 
at Dranconia State. 

(3) Programmatic responsiveness. Public higher 
education, more so than the private sector, has a 
responsibility to provide a wide range of learning 
experiences for individual citizens and to other- 
wise operate educational programs that serve the 
interests of the region, state, and nation. We can 
usefully think of responsiveness in two ways: 
first, programming to meet educational needs as 
they are presently determined to exist in the 
region; and second, anticipating future educa- 
tional needs and programming accordingly. The 
first is related to what I said earlier about mar- 
ket research, by which could be determined 
existing needs in the region for things like semi- 
nars to upgrade the competencies of various 
kinds of professionals; specific career prepara- 
tion programs such as nursing, industrial person- 
nel work, and computer technology; special serv- 
ices for women who wish to join the job market; 
adult basic literacy training; and so on. 

The second kind of responsiveness assumes 
rapid social changes in the land and sees the 
need for the institution to be in tune with these 
changes and possibly even help determine their 
direction. Planners and other idea men on the 
campus would be called upon to engage in some 
futuristics, to think about what the region or 
nation is likely to be like five, ten, or twenty 
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years in the riiture. Then, the task is to develop 
programs, not just training programs in such 
areas as child-care administration, community 
health services. consi»mer inlormation services, 
and birth control and family planning, but learn- 
ing experiences Tor entirely new audiences such 
as workers on a four-day week. The point is that 
campub planners would be initiating-opening up 
totally new fields rather than merely responding 
to dcMionstrated needs. 

Launching major innovations is never easy, for a 
host of reasons. Brand new programs are always 
calculated risks: it is best to begin on a small 
scale ?uid in a spirit of experimentation. With the 
money situation what it is, new programs will 
generally have to be offset by cutbacks in exist- 
ing programs of lower priority or across-the- 
board adjustments of some sort. The task of 
initiating innovative programs should always 
include a search for foundaiion or government 
seed money. And it will not be easy to integrate 
every new program with internal campus under- 
standings about the general goals of the institu- 
tion. Nevertheless, programmatic responsiveness 
-both to present exigencies and to a conception 
of the future-is* in my opinion, a most impor- 
tant index of college effectiveness, perhaps 
second only to .student learning. 

(4) Campus morale. Here I have in mind such 
qualities as faculty and student satisfaction with 
the general worth of the place-the sense that 
the college is a good place to be teaching and 
studying, commitment to the central values of 
the institution, cooperativeness, mutual respect, 
interpersonal trust. Word seems to get around 
about demoralized campuses as well as about 
those that are ''together." In regard to evalua- 
tion of campus morale, ETS's Institutional 
Functioning Inventory is a fairly good measure 
of institutional esprit. 

(5) Number. Most administrators, and others, 
have become quite adept at using numbers- 
various application and enrollment figures, for 
example~in justifying and describing the work 
of the institution. Simple counts are undoubted- 
ly the most common currency for reporting 
about campus operations and probably the one 
most readily understood in the upper echelons. 
To be sure, numbers can often be impressive, as 



when Dranconia's Hxecutive Vice President 
reports 5s2 \ 1 citizens, average age 4.S.73, travel- 
ing an average of 17.87 miles to participate in 
the college's continuing education program, with 
all these figures up "significantly'' from the pre- 
vious year. 

1 have placed the numbers criterion last he- 
cause I think it should be downgraded in the 
total scheme of things, which won't be easy witn 
continuing enrollment pressures and no addi- 
tional money. However, reliance on numbers as 
an effectiveness criterion encourages produc- 
tion-line arrangements and attitudes that, in the 
long run. are not in the best interest of anyone. 

^ ^ ^ 

In closing, let me return to an earlier point 
about trying not to respond to present dilemmas 
only in the terms of the budget cutter and effi- 
ciency auditor and doing nothing but find ways 
to educate more people at cut-rate prices. 

Instead, acad^rmic people, after getting them- 
selves together about the goals of their institu- 
tions, should go on the offensive. We can per- 
haps begin by noting that .American higher 
education has been to some extent the victim of 
its own success-that, for example, the univer- 
sities were too successful in turning out ioo 
many highly trained people in the 1960s. We can 
point to the promise of new achievements in the 
national interest in the years just ahead, such as 
universally meaningful higher education, broad 
university-based efforts to improve urban living 
conditions, and similar efforts to improve the 
quality of the physical environment all across 
the land. We can take a somewhal longer view 
and point out that there are already many indi- 
cations, such as new communications technol- 
ogy and greatly increased leisure time, that we 
may soon be reaching something akin to a true 
learning society and that the nation's colleges 
and universities will be called upon for aid on a 
scale that makes any presently conceived learn- 
ing delivery plans pale into insignificance.. We 
must testify that higher education is too essen- 
tial to a sane society, to a civilized existence, to 
the capacity of individuals to live productive and 
joyful lives to be consigned to the back burners 
of the state's fiscal stoves. 
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